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tISE  OF  LIKEARlEED  NOMLIMEAR  REGRESSION  FOR  S^UtlONS 
INVOLVING  MONti  GARLO  * 

John  E.  Walsh 

System  Development  Coirporation 

ABSTRACT 

Often^  for  each  simulation  situation^  a  Gomputer  run  involving  Monte 
Carlo  is  expensive  and  time  Gonsumlng.  However,  simulation  outGomes  are 
usually  desired  for  a  very  large  number  of  situations.  One  solution  to  this 
difflGulty  is,  from  a  feasible  number  of  runs,  to  develop  a  proGedure  for 
estimating  the  simulation  outGome  for  a  large  Glass  of  situations,  this  estl^ 
matlon  is  of  a  regression  nature,  the  type  of  regression  funGtion  used  should 
(1)  have  substantial  Gurve>fitting  flexibility  (2)  be  satisfaGtorlly  deter¬ 
mined  from  an  aGceptable  nuntber  of  simulation  runs  (3)  permit  Isolation  of 
important  GOmbinationS  of  effects,  and  (A)  be  computationally  manageable. 

It  is  also  highly  desirable  that  (5)  the  regression  analysis  has  a  satis¬ 
factory  probability  basis^  so  that  the  acGuracy  of  the  fit  from  the  data  can 
be  investigated.  The  linearized  nonlinear  regression  method  presented  here 
satisfies  (l)-(A),  and  s^e  nonprobabilistic  curve-fitting  procedures  for  deter¬ 
mining  a  regression  function  are  outlined.  This  regression  method  seems  to  also 
satisfy  (5)  and  the  probability  basis  developed^  along  with  some  estimation  re¬ 
sults,  is  presented.  Nse  of  the  linearized  nonlinear  regression  method  has 
desirable  features  for  optimizations. 


’^'fovited  paper  presented  at  the  First  Joint  TBIS-ORSA  National  Meeting, 
San  Francisco,  California,  November  S-IQ,  1961 
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INTRODUCTION 

For  the  oases  Gonsldered^  a  slmulatiOh  model  involving  Monte  Carlo  is 
programmed  for  application  on  a  high-speed  computer^  This  mathematical 
model  is  oompletely  specified  except  for  the  values  of  some  constants  which 
will  be  termed  inputs.  Some  of  the  inputs  refer  to  the  initial  and  other 
side  conditions.  The  Other  inputs  are  the  values  of  constants  that  occur  in 
the  functional  form  for  the  model.  Each  possible  choice  for  the  values  of  the 
Inputs  represents  a  simulation  situation. 

Given  the  inputs^  a  computer  run  of  the  simulation  process  yields  an  ob^ 
served  value  for  each  of  the  Outputs  that  is  considered.  These  outputs  re¬ 
present  the  results  of  this  random  simuiation.  Of  course^  any  specified  func¬ 
tion  of  the  directly  recorded  outputs  is  also  an  output.  For  the  cases  con¬ 
sidered  herej  all  inputs  and  outputs  are  real  numbers. 

For  a  fixed  set  of  input  values^  the  observed  values  for  a  specified 
output  are  a  random  sample  from  a  univariate  statistical  population.  The 
properties  of  these  statistical  populations  (a  possibly  different  population 
occurs  for  each  set  of  input  values)  are  the  quantities  of  interest.  Esti¬ 
mation  of  the  "value”  of  a  specified  output  refers  to  estimation  of  some 
suitable  "average"  property  of  the  statistical  population  for  this  output. 

Considered  over  a  number  of  sets  of  input  values^  the  "average"  used  is 
a  function  of  the  inputs.  In  general^  this  function  (referred  to  as  the 
"average"  function)  can  depend  on  the  totality  of  sets  of  input  values  that 
receive  consideration.  However^  use  of  this  function  to  furnish  "average" 
values  for  other  sets  of  inputs  ordinarily  should  not  result  in  great  error 
when  these  other  sets  are  of  an  interpolation  nature  with  respect  to  the  sets 
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on  which  the  "average"  function  la  baaed.  Aa  an  aid  in  the  development  of  a 
auitable  probability  models  a  afeclal  type  of  "average"  function  (a  generali¬ 
zation  of  the  median  concept)  ia  uaed  in  this  paper. 

The  problem  is  to  develop  a  aatiafactory  method  for  eatimating  the  "average" 
function  for  a  apeGified  output  (referred  to  aa  the  output)  on  the  baaia  of  an 
acceptable  number  of  computer  runa.  Since  atatiatical  variation  ia  involved^ 
this  eatimation  falla  under  the  general  heading  of  regreaaion.  However^  a  com¬ 
bination  of  desirable  features  occurs  that  ia  seldom  present  for  regression 
analyaea  baaed  on  data  from  the  usual  types  of  experimental  sources.  These 
features  include:  (a)  Any  'desired  number  of  observed  values  for  the  output 
are  obtainable  for  any  specified  set  of  values  for  the  Inputs  (b)  All  ebserved 
values  for  the  output^  irrespective  of  the  values  for  the  inputs^  are  statis-  > 

tlcally  independent  (c)  There  are  no  missing  value  difficulties. 

for  the  linearized  nonlinear  regression  method^  the  "average"  function  for 
estimating  the  output  is  represented  implicitly.  This  representation  ia  an 
equation  with  one  side  equal  to  a  simi  of  unknown  constants  times  completely 
specified  functions  of  the  values  of  the  inputs.  The  other  side  equals  the 
value  of  the  (unknown)  output  plus  a  sm  of  unknown  constants  times  completely 
specified  functions  of  the  value  of  the  output.  Given  values  (estimates)  for 

i 

the  unknown  constants^  and  the  values  of  the  inputs^  the  estimate  of  the  corres¬ 
ponding  output  is  determined  by  solution  of  the  resulting  equation.  < 

Conditions  are  imposed  to  assure  that  there  is  a  unique  solution  for  the 
output.  As  is  usual  for  regression  analysis^  the  completely  specified  functions 

» 

are  chosen  on  the  basis  of  technical  considerations  and  judgment.  Here^  however^ 
a  poor  selection  can  often  be  discovered  and  improved  on  the  basis  of  additional 
simulations. 


Witla  suitable  eholGe  of  the  completely  specified  fuaGtioflS,  a  GOnslderable 
amount  of  curve^f itting  flexibility  can  be  obtained  without  the  introduetion 
of  very  many  unknown  Gonstants^  Since  only  a  moderate  number  of  GOnStantS  are 
to  be  estimated^  reasonably  stable  estimates  should  be  obtainable  without  an 
excessively  large  number  of  simulation  runSi  The  linearity  of  the  representation 
Implies  that  Important  combinations  of  effects  (specified  linear  functions  of 
the  unknown  constants)  can  be  isolated  without  difficulty;  also  that  most  of  the 
computations  to  be  performed  are  of  a  linear  nature  and  therefore  not  overly 
difficult. 

Two  types  of  methods  are  presented  for  determining  linearized  nonlinear 
regression  functions  (that  is,  for  estimating  the  unknown  constants  in  a  tea- 
gresslon  function).  One  method  does  not  have  a  probabilistic  basis  and  the 
constants  are  determined  on  the  basis  of  curve'^fittlng  criteria,  for  the  other 
method;  approximate  median  estimates  and  approxtmate  confidence  intervals  are 
obtained  for  the  unknown  values  of  the  constants.  The  nonprobabllistie  method 
is  easier  to  apply  and;  to  some  extent^  its  suitability  can  be  checked  by 
further  simulations.  The  probabilistic  method  allows  direct  evaluation  to  be 
made  of  the  effects  of  statistical  variation  on  the  estimates  for  the  constants 
in  the  regression  function. 

Any  probability  model  developed  should;  from  practical  necessity;  be  valid 
for  virtually  all  Monte  Carlo  simulations  and  linearized  nonlinear  regressipn 
functions  that  might  reasonably  be  encountered.  The  probability  model  given 
in  this  paper  has  this  generality  of  application.  A  further  develppment;  for 
which  work  is  now  underway;  consists  in  deriving  approximate  confidence  intervals 
for  the  sum  of  the  terms  which  involve  the  Inputs  (for  any  specified  set  of 
values  for  these  inputs).  These  confidence  intervals  would  permit  investigation 
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of  the  Gver»all  effect  of  atatistical  variation  on  the  regression  funGtlon  for 
a  stated  set  of  input  values. 

Consider  a  measure  of  effeGtiveneSS  whose  value  is  a  funGtlon  of  the  direct 
OiitputtS  of  the  simulation^  For  example,  this  might  be  the  total  worth  of  the 
targets  destroyed  for  an  offense  versus  defense  simulation.  This  measure  of 
effectiveness  is  itself  an  output  which  depends  on  the  inputs  (in  an  unknown 
fashion)  and  can  be  represented  by  a  linearized  nonlinear  regression  function. 
Stepwise  maximization  (or  minimization)  of  this  output  can  be  conveniently 
accomplished  by  appropriate  use  of  the  regress ion  method  presanted  in  this 
paper. 

it  should,  perhaps,  be  emphasized  that  the  estimation  function  is  only 
intended  for  use  in  situations  of  an  interpolation  nature.  That  ls>  situations 
where  the  set  of  values  for  the  inputs  has  an  interpolation  positlpn  with  res¬ 
pect  to  the  sets  of  values  used  in  determining  the  linearized  nonlinear 
gression  function. 

The  next  section  contains  some  discussion,  a  statement  of  notation,  and  a 
brief  general  introduction  to  regression  analysis.  The  following  section 
presents  a  general  statement  of  the  linearized  nonlinear  regression  model. 
Curve-fitting  methods  for  determining  a  regression  function  are  considered  in 
the  next  section.  The  next  to  last  section  contains  a  statement  of  the  proba¬ 
bility  model  and  presents  point  estimates  and  confidence  intervals  for  the 
unknown  constants  in  the  regression  function.  The  final  section  contains  an 
outline  of  the  method  used  to  optimize  a  measure  of  effectiveness. 
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DISCUSSION  AND  NOTATICTi 

In  many  aenses^  regression  consists  of  curve>f itting  in  the  presence  of 
Statistical  variation.  Linear  regression^  which  expresses  the  "average"  value 
of  the  output  as  a  linear  function  of  the  inputs  (or  completely  specified  func« 
tions  of  the  inputs)  has  computational  advantages  but  restricted  curve-fitting 
flexibility.  In  many  cases,  poor  agreement  between  observed  values  of  the  out¬ 
put  and  their  regression  estimates  may  be  due  to  inability  of  the  linear  func¬ 
tional  form  to  provide  a  good  fit  rather  than  a  result  of  large  Statistical 
variation.  A  basic  problem  is  to  develop  a  regression  method  that  has  sub¬ 
stantial  Curve-fitting  flexibility  without  Substantial  changes  in  the  desirable 
computational  properties  that  occur  for  linear  regression. 

Let  y  represent  the  output  while  x^,...,Xj.  represent  the  inputs^  The  data 
for  the  i-th  of  n  sitnulatiOns  is  represented  by 

(yiiXi^j  •  •  •  (i  * 

Then,  in  general,  a  regression  relation  can  be  expressed  in  the  form 

y  ^  h(X|^,. . .  ,Xj^jAj^,. .  •  ,A^), 

where  the  function  h  is  completely  specified  except  for  the  values  Of  the  un¬ 
known  constants  A]^,.«>,A^.  That  is. 


y^  *  h(Xj^,. . . ,Xj^^jAj^,. . . ,Aj.)  +  e^,  (i  ^  l,.,.,n), 

where  the  e^  are  random  errors  and,  for  the  situations  considered  in  this  paper, 
statistically  independent. 


i 
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It  Is  to  be  emphasized  that>  in  general,  each  of  the  e^^  couid  have  a 
Substantially  different  (unknown)  probaotllty  distribution^  Also,  the  use 
of  a  regression  function  with  a  large  amount  of  Gurve-f Ittlng  flexibility  Is 
helpful  In  redUGlng  the  magnitude  of  the  e^,  since  a  part  of  this  magnitude 
Is  due  to  inability  of  the  regression  function  to  adequately  represent  the 
"fixed  parts"  of  the  y^,. 

LINEARIZED  NONLINEAR  REGRESSION  MODELS 
Let  the  range  of  possible  values  for  y  be  y^^  ^  y  ^  y^,  where  y^^  b  -  « 
and  y^  «•  »  are  possibilities.  The  approach  consists  In  eXpresS^'ig  the  re- 
gressloh  function  in  a  transformed  manner.  Specifically,  let  g^Cy),. . . ,g^(y)> 
usually  monotonic  for  yj^  ^  y  ^  y^j  be  specified  functions  of  y  while 
(x  . . . , 

function  is  expressed  as 


Xj^)  are  specified  funetions  of  the  regression 


•  •  •  > 


<l)  y  +  Ajgj(y)+...4A^gg(y)  «  A^^+A^28»+2^*l'’ ’  • +  ...  +  A^g^Cx^,. . . ,x^), 

where  A.,..., A  are  restricted  by  the  condition  that  y  4-  ...  =4  A  g  (y)  is  a 
monotonic  function  of  y  for  yj^  ^  y  ^  yy  If  h(xj,,,.,X|^;A^,...,Aj.)  denotes 
the  solution  of  equation  (1)  for  y  in  the  range  y^  ^  y  y^ 

y  w  h(Xj^>. . .  ,X|^;A^,. . .  ,A^) 

is  an  alternate  way  to  express  the  regression  function.  This  alternate  ex¬ 
pression  is  used  to  esttoate  y  for  given  (xj^,.. .,Xj^}. 

The  functions  8g.|.2^* selected  on  technical  grounds  while  gj^^.t.^g^ 
are  selected  partially  for  curve-fittins  generality  and  partially  on  technical 
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grounds;  none  of  g^Cy) . jg^Cy)  is  linear  in  ys  Use  Of  y  as  One  of  the  linear 
tertns  of  (1)  represents  a  standardization;  it  also  assures  that  linear  regression 
oan  ooour  as  a  speGial  ease. 

The  linear  form  of  (1)  with  respeet  to  allows  many  types  of  speci'^ 

fled  linear  combinations  of  Ap...^A^  to  be  Isolated  by  the  solution  of  linear 
equations.  Since  y  is  a  monotonlc  function  of  the  quantity 

^s+1  *  ^S+2®S4-2^*P“’**k^  +  ...  + 

isolation  of  Specified  linear  combinations  of  are  of  especially 

great  Interest. 

Not  all  types  of  specified  linear  combinations  Of  can  be  iSO^ 

lated  by  the  straightforward  procedure  of  solving  linear  equations.  The  values 
of  Aj^,..,,Ag  are  restricted  by  the  monotonlclty  condition  on  y  +  Ajgj(y)  4> 

...  -b  A  g  (y).  However,  some  number  of  A.,..., A  can  be  considered  to  have 
restricted  values.  Any  specified  linear  combination  of  And  an  un» 

restricted  subset  of  Ap...,A^  can  be  isolated  by  the  solution  of  linear  equations. 


CURVE^FITTING  RESULTS 

Here  the  problem  is  to  obtain  point  estimates  for  Aj^,...,A^  on  the  basis 
of  the  and  a  criterion  that  seems  to  be  intuitively  satisfactory 

but  for  which  no  specific  probability  basis  is  established.  Actually^  estlaiation 
of  A^j^,...,A^  and  a  maximum  number  of  unrestricted  constants  of  the  set  Ap 
..,,Ag  is  all  that  is  explicitly  considered,  For  convenience  of  presentation^ 

A. .....A  .  are  considered  to  be  restricted  while  the  values  of  A  .....A  are 

^  r.-!  -  -  -  _  ,  g  ^  ^ 


unrestricted. 
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The  felatldiia  that  futnish  the  basis  for  the  esttmatlOn  are 


(2)  y^igi(yp+...4A^g^(yP  - 

for  1  »  l^...^n.  The  first  step  Is  to  Gombine  these  relations  so  that  n  new 
relations  are  obtained  which  are  linear  in  and  do  not  contain  Aj^j. * . jA^_j^. 

This  can  be  acGOmplished  in  tnany  reasonable  ways  by  forsiing  n  overlapping  groiips 
of  relations^  where  each  group  contains  r  relations.  Then^  for  each  groups  a 
combined  linear  relation  is  determined  wherein  are  eliminated^ 

let  the  relationa  resulting  from  these  combinations  be 


K 


oi 


K  ,A 
rl  r 


K  jA.  a  M...  .A  ,  + 
si  s  (a+1)  1  S‘bl 


i  m  Where  the  K's  have  determined  values.  Then  least-squares  is  used 

to  determine  estimates  for  A^^...^A^.  That  is,  the  estimates  are  the  values 
such  that 

n 

J^^ol  ■*'  NA  ^  *^slS  *  -(8+l)i^8+l  ’  '  ^tlV” 

1«1 

i 

if  minimum.  There  are  standard  procedures,  also  computer  programs,  available 
for  handling  this  least^squares  situation. 

Given  estimates  for  A^,...;A^,  determination  of  suitable  estimates  for 
A|^,...jA^_l  represents  a  specialized  problem  that  depends  on  g|(y),t>*iggCy)f 
However,  in  any  given  case  where  these  functions  are  strictly  monotonic  and  r 
is  small,  solution  of  this  specialized  problem  should  not  be  overly  difficult* 


1962  11  SP“487 

Iri  partlGulatj  determining  a  suitable  estimate  for  Should  not  be  difficult 
for  cases  Where  r  *  2. 

The  estimation  method  outlined  here  is  but  one  of  many  possible  typeSi 
However^  it  does  have  the  advantages  of  a  reasonable  intuitive  basis  and  ease 
of  application. 

PROBABILITY  RESULTS 

The  output  y^  has  a  probability  distribution  but  the  corresponding  inputs 
^li'’**^^ki  fixed  values^  The  y^  are  independent  but  the  shape  of  the 
distribution  of  y^  is  not  assumed  to  bear  any  definite  relation  to  the  shape  of 
the  distribution  of  y^  for  i  j*  j. 

The  key  feature  of  the  probability  model,  which  allows  useful  results  to 
be  developed  for  heterog^eous  cases,  is  the  method  used  to  define  what  Aj^,ii.,A^ 
represent.  That  is,  to  specify  the  type  of  "average"  function  that  is  considered. 

By  some  data  manipulations,  a  few  "observations"  are  constructed  that  ate 
statistically  independent  and  of  the  form 

Y(u;v)  ^  A^  +  e(ujv),  (u  ■  l,.,.,tO| 

where  e(u;v)  represents  the  random  error.  Let  p(u;v)  be  the  value  of  P[Y(u;v) 

£  A^]  and  define  A^  by  the  requirement  that  the  arithmetic  average  of  p(u;v) 
over  u  is  equal  to  Then  an  approximate  median  estimate  can  be  obtained  for 
A^  on  the  basis  of  Y(l;v),...,Y(y;v).  Also,  confidence  intervals  can  be  ob» 
tained  for  A^  that  have  confidence  coefficients  which  are  nontrivially  bounded 
from  below. 
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The  first  step  cohSlSts  in  dividing  the  n  relations  (2):  Into  mutually 
exclusive  groups  of  size  t  (some  groups  may  be  of  size  t  1).  To  avoid  bias^ 
and  not  as  a  part  of  the  underlying  probability  models  randomization  is  used 
to  make  the  subdivision  into  sets  (so  that  all  possible  subdivisions  are  equally 
likely).  Nextj  separately  for  each  setj  by  solution  of  t  linear  equations  in 
t  unknowns^  a  value  is  determined  for  each  of  For  n  reasonably  large 

compared  to  t^  this  furnishes  a  number  of  separate  ''estimates"  for  A^(v  >  lji..jt) 

Nextj  for  each  A ^  its  "estimates”  are  grouped  into  U  classes^  where  each 
class  contains  approximately  the  same  number  of  "estimates"  (some  classes  may 
contain  one  more  "estimate"  than  others) «  The  grouping  Into  classes  Is  the  same 
for  each  A^  and,  to  avoid  bias,  this  grouping  is  determined  by  randomization. 

The  "observation"  Y(u;v)  is  the  arithmetic  average  of  the  "estiinates"  for  A^  that 
occur  in  the  u-th  class. 

The  value  chosen  for  U  should  not  be  too  large  and,  for  convenience  in  ob« 
taining  approximate  median  estimates,  should  be  odd.  Also  tJ  should  not  be  too 
small  (say,  U  ^  5);  otherwise  suitable  values  are  not  available  for  the  lower 
bounds  for  the  values  of  confidence  coefficients. 

The  approximate  median  estimates  and  confidence  intervals  for  A^  are  based 
on  order  statistics  of  the  Y(u;v).  let 

Y^[l]  gYjZ]  g,,.  ^Y^[U] 

be  the  ordered  values  of  Y(l;v),...,Y(y;v)  and  suppose  that  U  is  odd.  Then 
(y 1)  /2}  is  approximate  median  estate  of  A^,  That  is, 

L  g  FU^IOJ  +  l)/2]  ^  A^)  $  1  -  L, 


t 
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where  Is  hot  greatly  differeht  from  i.  Here  L  =  i  438  for  U  =  3> 

=  .421  for  U  =  5,  =  .414  for  U  =  7>  =  .410  for  U  =  9^  and  =  .407  for  0  =  11. 
These  results  are  Obtained  on  the  basis  of  the  material  presented  in  ref.  1. 
Tlie  following  relations  define  approximate  oonfidenee  intervals  for 
(v  = 

s  i  0 )“  £  (S  ). 

U=Ui, 


where  Uj^  <  U/2,  >  U/2>  Y^[03  ^  ^  and  Y^[n  +  1]  =  ».  These  results  follow 

direetly  from  ref.  1. 

If  n  is  large^  the  dlstrtbutlpns  of  Y(l;v),. . .  jY(yjv)  are  approxiinatety 
continuous  and  should  be  at  least  roughly  the  same.  Then  Y^iCV  #  l)/2]  should 
be  very  nearly  a  median  estimate  of  and  the  values  of  the  confidence  co'* 
efficients  should  nearly  equal  the  lower  bound  values  (See  ref.  2  and  3). 

As  for  the  curve*fitting  case^  a  complication  arises  because 
are  restricted.  Here  too^  the  procedure  is  to  first  obtain  estimates  for  a 
set  such  as  A^^...yA^  and  then  consider  estimation  for  the  restricted  set 
Aj^,, , . The  confidence  intervals  that  are  obtainable  for  each  of  Aj^,...,A^ 
can  be  useful  in  determining  the  estimates  for  these  unknown  constants. 

The  probability  model  used  is  based  on  the  general  approach  presented  in 
ref.  3.  That  is^  this  is  a  special  case  where  the  "median"  is  the  generalized 
percentage  point  that  is  considered. 


OPTIMIZATICM  USE 

Here  the  output  considered  is  a  measure  of  effectiveness  that  depends  (in 
some  unknown  way)  on  The  problem  is  to  determine  a  set  of  values  for 

Xp,..,xj^  that  is  optimum  (for  example,  that  maximizes  this  output). 
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As  a  pfelimlnaty  S£ep^  the  Values  of  S^t  are  chosen  and  the  funGtionS 
are  decided  upon,  then  a  first  approximation  to  the  .measure  of 
effectiveness^  as  a  function  of  the  x*s^  is  obtained  for  sets  of  values  that 
cover  a  broad  region  in  the  (Xp...jX^)- space.  Ixamlnatlon  of  this  resulting 
regression  function  should  lead  to  a  substantial  decrease  In  the  size  of  the 
region  In  which  the  optimum  Xp...^x^  can  be  expected  to  lie. 

Additional  observed  outputs  are  obtained  for  values  of  x^^..ijx^  In  the 
restricted  region  and  the  regression  function  1$  redetermined  exclusively  on 
the  basis  of  observations  pertaining  to  this  region.  Examination  of  this  second 
approximation  to  the  measure  of  effectiveness  as  a  function  of  x^^.t.^x^  should 
yield  a  further  decrease  In  the  size  of  the  region  where  the  optimum  point 
Should  lie.  Continuation  of  this  procedure  through  several  stages  should 
ordinarily  furnish  a  good  appreximatlon  to  the  optimizing  value  of  x^j...|Xj^. 
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Unclassified  report 

SESCRlFfORS:  Equations.  Monte  Carlo  Method.  Simulation. 

Reports  that  a  eOnputer  run  for  each 
situation  involving  Monte  Carlo  is  often 
expensive  and  time  consuming,  hut  that 
Simulation  outcomes  are  usually  desired 
for  a  very  large  ntimber  of  situations. 

Presents  a  linearized  nonlinear  UNCLASSLFL^ 


regression  method  which  has  suhstantial  UNCLASSIFIED 

curve*fitting  flexibility,  is 

satisfactorily  determined  from  a 

number  of  simulation  runs,  and  is 

computationally  manageable.  Outlines 

some  nonprobabillstic  c\u^e«^fittlng 

procedures  for  determining  a 

regression  function.  Concludes  that 

the  use  of  the  linearized  nonlinee^ 

regression  method  has  desirable 

features  for  optimizations. 
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